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(57) Abstract 



A Very Long 
Instruction Word (VUW) 
processor having a plurality 
of functional units includes 
a multiported register 
file that is divided into a 
plurality of separate register 
file segments, each of 
the register file segments 
being associated to one of 
the plurality of functional 
units. The register file 
segments are partitioned 
into local registers and 
global registers. The global 
registers are read and 
written by all functional 
units. The local registers 
are read and written only by 
a functional unit associated 
with a particular register file 
segment. The local registers 
and global registers are 
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LOCAL AND GLOBAL REGISTER PARTITIONING IN A VLIW PROCESSOR 
TECHNICAL FIELD 

Tbe present invention relates to storage or memory in a processor. More specif.ca.ly. the present 
invention relates to a storage having local and g.oba. access regions for substructions in a Very Long 
Instruction Word (VLIW) processor. 

BACKGROUND ART 

One technique for improving the performance of processors is parallel execution of multiple instructions 
,o allow the instruction execution rate to exceed the clock rate. Various types of parallel processors have been 
developed including Very Long Instruction Word (VLIW) processors that use multiple, independent funcnonal 
units to execute multiple inactions in parallel. VLIW processors package multiple operations mto one very 
,o„g inaction, me mult^^ 

functional units. An instruction has a set of fields corresponding to each functional unit. Typ.ca. b,t engths of a 
subinstroctioncommonlyrangefrom 16 to 24 bits per functional unit to produce an instruction length oftenma 
range from 1 12 to 168 bits. 

The multiple functional units are kept busy by maintaining a code sequence with sufficient opemticns to 
keep mictions scheduled. A VLIW processor often uses a technique calle d trace schedu.ing to maunam 
schedulingefftciency by unrolling loops ^.j^,*.™™'^^ 
also improves efficiency by allowing instructions to move across branch points. 

Limitations of VLIW processing include limited parallelism, limited hardware resources, and a vast 
increase in code size. A limited amount of parallelism is available in instruction sequences. Unless loops are , 
unrolled a very large number of times, insufficient operations are available to fill the instructions. Lmuted 
hardware resources are aproblem. not only because of duplication of functional units but more importantly due 
to a large increase in memory and register file bandwidth. A large number of read and write ports are necessary 
for accessingtheregister file. > a ^*}m^M<l^»^^^~**~'* 
the register file and degradation in clock speed. As the number of ports increases, the complexity of the memory 
system further increases. To allow multiple memory accesses in parallel, the memory is divided into multiple 
banks having different addresses to reduce the likelihood mat multiple operations in a single insuuctton have 
conflicting accesses that cause the processor to stall since synchrony must be maintained between the functtona. 



units. 
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Code size is a problem for several reasons. The generation of sufficient operations in a nonbranchmg 
code fragment requires substantia, unrolling of loops, increasing the code size. Also, instructions that are not full 
may inch.de unused subinstructions that waste code space; increasing code size. Furthermore, the increase m the 
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size of storages such as the register file increase the number of bits in the instruction for addressing registeis in 
the register file. 

A register file with a large number of registers is often used to increase performance of a VLIW 
processor. A VLIW processor is typically implemented as a deeply pipelined engine with an "in-order- 
execution model. To attain a high performance a large number of registers is utilized so that the multiple 
functional units are busy as often as possible. 

A large register file has several drawbacks. First, as the number of registers that are directly addressable 
is increased, the number of bits used to specify the multiple registers within the instruction increases 
proportionally. For a rich instruction set architecture with, for example, four register specifiers, an additional bit 
for a register specifier effectively costs four bits per subinstruction (one bit per register specifier). For a VLIW 
word with four to eight subinstructions. sixteen to thirty-two bits are added for instruction encoding. Second, a 
register file with many registers occupies a large area. Thiid, a register file with many registers may create 
critical timing paths and therefore limit the cycle time of the processor. 

What is needed is a technique and processor architecture enhancement that improves the efficiency of 
instruction coding but still allows access to a large set of arehitecturally-visible registers. 

DISCLOSURE OF INVENTION 

A Very Long Instruction Word (VLIW) processor having a plurality of functional units and includes a 
multi-potted register file that is divided into a plurality of separate register file segments, each of the register file 
segments being associated to one of the plurality of functional units. The register file segments are partitioned 

20 into local registers and global registers. The global registeis are read and written by all functional units. The 
local registers are read and written only by a functional unit associated with a particular register file segment. 
The local registers and global registers are addressed using register addresses in an address space that is 
separately defined for a register file segment/ functional unit pair. The global registers are addressed within a 
selected global register range using the same register addresses for the plurality of register file segment/ 

25 functional unitpaiis. The local registers in a register file segment are addressed using register addresses in a 
local register range outside the global register range that are assigned within a single register file segment/ . 
functional unit pah. Register addresses in the local register range are the same for the plurality of register file 
segment/ functional unit pairs and address registers locally within a register file segment/ functional unit pair. 

A VLIW processor utilizes a very long instruction wort that includes a plurality of subinstructions. The 
30 subinstructions are allocated into positions of the instruction wort. The VLIW processor includes a register file 
that is divided into a plurality of register file segments. The VLIW processor also includes a plurality of 
functional units, each of which is coupled to and associated with a register file segment of the register file. Each 
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number N G of global registers is senu ^ The 224 

otherwise required to access 224 renters. P . |ocal 

,92-223 in register file segment 3 are all addressed using register addresses 96-127. 

One address bit is thus saved for each of the four substruction positions, a savings of four bits per 

advantageousmaVUWproces^^^^ 
5 instructions, each of which is to be encoded in the VLIW instruction word. 

„ N of local registers is selectable and variable. For example, a regtster file including four 

-.i. , k .m re „ isters addressed using seven address bits. Alternatively, the 
_,«.:«-« and 0 local registers with the 128 registers aaaresseu i» 15 

local registers so thatthe total number of regtsters u64 + (4-64) - 320 registers 
bits rather man the9bi«sthat would odierwise be required to address 320 registers. 
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BRIEF DESCRIPTION OF DRAWINGS 

The features of the described embodiments are specifically set forth in the appended claims. However, 
embodiments of the invention relating to both structure and method of operation, may best be understood by 
referring to the following description and accompanying drawings. 

FIGURE 1 is a schematic block diagram illustrating a single integrated circuit chip implementation of a 
processor in accordance with an embodiment of the present invention. 

FIGURE 2 is a schematic block diagram showing the core of the processor. 

FIGURE 3 is a schematic block diagram that illustrates an embodiment of the split register file that is 
suitable for usage in the processor. 

FIGURE 4 is a schematic block diagram that shows a logical view of the register file and functional 
units in the processor. 

FIGURES 5A, 5B, and 5C show a schematic block diagram of a divided or split register file, a high 
level view of computation elements of a junctional unit, and a pictorial view of an instruction format, 
respectively, which are used to illustrate the difficulty of defining an instruction format with a limited number of 
instruction bits. 

FIGURE 6 is a schematic block diagram showing a register file for a VLI W processor that includes 
global and local register partitioning. 

FIGURE 7 illustrates a schematic block diagram of an SRAM array used for the multi-port split register 

file. 

FIGURE 8A and 8B are, respectively, a schematic block diagram and a pictorial diagram that illustrate 
the register file and a memory array insert of the register file. 

FIGURE 9 is a schematic block diagram showing an arrangement of the register file into the four 
register file segments. 

FIGURE 10 is a schematic timing diagram that illustrates timing of the processor pipeline. 
The use of the same reference symbols in different drawings indicates similar or identical items. 
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■ , «io» of accessor 100 that includes a memory interface 102, a geometry decompressor 104. *vo 
imPlemematKm P "71 , 12 a ^ data cache 106, and severa! interface confer,, me interface 

controUers support „„ . single die . Tne components are 
components of memory, graph.cs, and inputfoutp low ., atency communication 

mumallylinkedandcloselyl^^ * ^ 

• /orn rontrnller 120 The illustrative memory interface 102 is a direct nam* / 
component interconnect (PCI) "^*^V . a ^ , shared among the media 

RAM (DRDRAM) controller. The shared data cache dua <» &ur . 

• » 1 10 and 112 with one port allocated to each media processing unit meoata 

S============- 

between the media processing units 1 10 and 112. 

controller 116 attains reduced latency on cache misses ana impro <= . ,« r„ r Mrh 

controller no ana. Directory-based systems maintain coherence states for each 

memory. The UPA controller 116 is a centralized system control.* that removes the need to place cache 
coherl !o g ic on the processor 100 and DMA devices, thereby simplifying the circuitry. 

volume low-cost peripheral devices, almough omer stanoard mterfa«s may also b. used The PC^ 
volume, .ow h'oh handwidth oeripherals and low bandwidth peripherals, such as CD-ROM 

effectively transfers data among high bandwidth penpnerais an 

players, DVD players, and digital cameras. 

, • - fi.«m »nv sources such as the same application, different applications, the 
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operates on two independent threads, possibly attaining twice the performance of a processor having the same 
resources and clock rate but utilizing traditional non-thread parallelism. 

Thread level parallelism is particularly useful for Java™ applications which are bound to have multiple 
threads of execution. Java™ methods including "suspend", "resume", "sleep", and the like include effective 
support for threaded program code. In addition, Java™ class libraries are thread-safe to promote parallelism. 
(Java™, Sun, Sun Microsystems and the Sun Logo are trademarks or registered trademarks of Sun Microsystems, 
Jnc. in the United States and other countries. All SPARC trademarks, including UltraSPARC 1 and UltraSPARC 
\1 % are used under license and are trademarks of SPARC International, Inc. in the United States and other 
countries. Products bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems, 
Inc.) Furthermore, the thread model of the processor 100 supports a dynamic compiler which runs as a separate 
thread using one media processing unit 1 10 while the second media processing unit 112 is used by the current 
application. In the illustrative system, the compiler applies optimizations based on "on-the-fly" profile feedback 
information while dynamically modifying the executing code to improve execution on each subsequent run. For 
example, a "garbage collector" may be executed on a first media processing unit 110. copying objects or 
1 5 gathering pointer information, while the application is executing on the other media processing unit 112. 

Although the processor 100 shown in FIGURE I includes two processing units on an integrated circuit 
chip, the architecture is highly scaieable so that one to several closely-coupled processors may be formed in a 
message-based coherent architecture and resident on the same die to process multiple threads of execution. Thus, 
in the processor 100, a limitation on the number of processors formed on a single die thus arises from capacity 
constraints of integrated circuit technology rather than from architectural constraints relating to the interactions 
and interconnections between processors. 

Referring to FIGURE 2, a schematic block diagram shows the core of the processor 100. The media 
processing units 110 and 112 each include an instruction cache 210, an instruction aligner 212, an instruction 
buffer 214, a pipeline control unit 226, a split register file 216, a plurality of execution units, and a load/store unit 
218. In the illustrative processor 100, the media processing units 110 and 112 use a plurality of execution units 
for executing instructions. The execution units for a media processing unit 1 10 include three media functional 
units (MFU) 220 and one general functional unit (GFU) 222. The media functional units 220 are multiple single- 
instruction-multiple-datapath (MSIMD) media functional units. Each of the media functional units 220 is 
capable of processing parallel 16-bit components. Various parallel 16-bit operations supply the single- 
instruction-multiple-datapath capability for the processor 100 including add, multiply-add, shift, compare, and 
the like. The media functional units 220 operate in combination as tightly-coupled digital signal processors 
(DSPs).' Each media functional unit 220 has an separate and individual sub-instruction stream, but all three 
media functional units 220 execute synchronously so that the subinstructions progress lock-step through pipeline 
stages. 
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The general functional unit 222 is a RISC processor capable of executing arithmetic logic unit (ALU) 

common paralle. operations such as the parallel reciprocal square root instruct. 

• ■ Terence allowing dynamic optimizations through self-modifying code. Software is used to .nd.cate 

on nvesy single .lore operators Issued ■»*• ■•** f""" 1 " 8 ™* 

W*. oorero, - » » co«rec»db=»ren *. toarootfon a*** 

z.1— . ^* 

TTie pipeline control unit 126 also gemerales traps and maintains special registers. 
^ralronerton.lsnirPsa. „^ilh^-c< rf i»o»,«*re si ,»c«,.sc l ro CT .2 2 4oram32. I 
sra ool aeoisible or "visible" to other funcdonnl onus. 

' »^,ro^— •"-•"-^■^-^^"r*'*" 
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10 L^etaro.r.fclravtolroto,^^ Tnnr^rarton.l h^erv*«n 
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execute in the media functional units (MFU) 220. A MFU instruction field within the VLIW instruction word 
includes an operation code (opcode) field, three source register (or immediate) fields, and one destination register 
field. 

Instructions are executed in-order in the processor 100 but loads can finish out-of-order with respect to 
other instructions and with respect to other-loads, allowing loads to be moved up in the instruction stream so that 
data can be streamed from main memory. The execution model eliminates the usage and overhead resources of 
an instruction window, reservation stations, a re-order buffer, or other blocks for handling instruction ordering. 
Elimination of the instruction ordering structures and overhead resources is highly advantageous since the 
eliminated blocks typically consume a large portion of an integrated circuit die. For example, the eliminated 
blocks consume about 30% of the die area of a Pentium II processor. 

To avoid software scheduling errors, the media processing units 110 and 112 are high-performance but 
simplified with respect to both compilation and execution. The media processing units 110 and 112 are most 
generally classified as a simple 2-scalar execution engine with full bypassing and hardware interlocks on load 
operations. The instructions include loads, stores, arithmetic and logic (ALU) instructions, and branch 
instructions so that scheduling for the processor 100 is essentially equivalent to scheduling for a simple 2-scalar 
execution engine for each of the two media processing units 1 1 0 and 112. 

The processor 100 supports full bypasses between the first two execution units within the media 
processing unit 110 and 112 and has a scoreboard in the general functional unit 222 for load operations so that 
the compiler does not need to handle nondeterministic latencies due to cache misses. The processor 100 
scoreboards long latency operations that are executed in the general functional unit 222, for example a reciprocal 
square-root operation, to simplify scheduling across execution units. The scoreboard (not shown) operates by 
tracking a record of an instruction packet or group from the time the instruction enters a functional unit until the 
instruction is finished and the result becomes available. A VLIW instruction packet contains one GFU 
instruction and from zero to three MFU instructions. The source and destination registers of all instructions in an 
incoming VLIW instruction packet are checked against the scoreboard. Any true dependencies or output 
dependencies stall the entire packet until the result is ready. Use of a scoreboarded result as an operand causes 
instruction issue to stall for a sufficient number of cycles to allow the result to become available. If the 
referencing instruction that provokes the stall executes on the general functional unit 222 or the first media 
functional unit 220, then the stall only endures until the result is available for intra-unit bypass. For the case of a 
load instruction that hits in the data cache 106, the stall may last only one cycle. If the referencing instruction is 
on the second or third media functional units 220, then the stall endures until the result reaches the writeback 
stage in the pipeline where the result is bypassed in transmission to the split register file 216. 
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stream. 

produces the results following the latency of the instruction. 

k„.,< Therefore data feeding specifications of the processor 100 are far 
beyond ftcoptbililte of cosi-effttove monoiy systnm. Sumcion am ° 
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includes twelve read ports and five wriie ports, supplying total data read and write capacity between the central 
registers of the split register file 216 and all media functional units 220, the general functional unit 222 and the 
load/store unit 218 that is connected to the general functional unit 222. The five write ports include one 64-bit 
write port that is dedicated to load operations. The remaining four write ports are 32 bits wide and are used to 
write operations of the general functional unit 222 and the media functional units 220. 

Total read and write capacity promotes flexibility and facility in programming both of hand-coded 
routines and compiler-generated code. 

Large, multiple-ported register files are typically metal-limited so that the register area is proportional 
with the square of the number of ports. A sixteen port file is roughly proportional in size and speed to a value of 
256. The illustrative split register file 216 is divided into four register file segments 310, 312, 314, and 316, each 
having three read ports and four write ports so that each register file segment has a size and speed proportional to 
49 for a total area for the four segments that is proportional to 1 96. The total area is therefore potentially smaller 
and faster than a single central register file. Write operations are fully broadcast so that all files are maintained 
coherent. Logically, the split register file 216 is no different from a single central register file However, from 
the perspective of layout efficiency, the split register file 216 is highly advantageous, allowing for reduced size 
and improved performance through faster access. 

The new media data that is operated upon by the processor 100 is typically heavily compressed. Data 
transfers are communicated in a compressed format from main memory and input/output devices to pins of the 
processor 100, subsequently decompressed on the integrated circuit holding the processor 100, and passed to the 
split register file 216. 

Splitting the register file into multiple segments in the split register file 216 in combination with the 
character of data accesses in which multiple bytes are transferred to the plurality of execution units concurrently, 
results in a high utilization rate of the data supplied to the integrated circuit chip and effectively leads to a much 
higher data bandwidth than is supported on general-purpose processors. The highest data bandwidth requirement 
is therefore not between the input/output pins and the central processing units, but is rather between the 
decompressed data source and the remainder of the processor. For graphics processing, the highest data 
bandwidth requirement is between the geometry decompressor 104 and the split register file 216. For video 
decompression, the highest data bandwidth requirement is internal to the split register file 216. Data transfers 
between the geometry decompressor 1 04 and the split register file 21 6 and data transfers between various 
registers of the split register file 216 can be wide and run at processor speed, advantageously delivering a large 
bandwidth. In addition, the split register file 216 can be multiported which further increases total bandwidth. 



The register file 216 is a focal point for attaining the very large bandwidth of the processor 100. The 
processor 100 transfers data using a plurality of data transfer techniques. In one example of a data transfer 
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up t0 eight bytes per cycle. In another example, streaming data * transferred to the spht reg.ster frte 2. 6 h ro u g h 
grouploadopemtionswhichtnnsfe^^^^ 

Asters. For example, the processor, 00 utilizes the streaming da« operation to receive compressed v.deo data 
5 for decompression. 

Compressed graphics data is received via a direct memory access (DMA) unit in the geometry 
decompressor ,04. The compressed graphics data is decompressed by the geometry decompressor ,04 and 
lo'aded at a high bandwidth rate into the split register f.ie 2, 6 via group .oad operations that are mapped to the 
geometry decompressor 104. 
10 Load operations a* non-blocking and scoreboarded so that a long latency inherent to loads can be 

hidden by early scheduling. 

Genera, purpose applications often fail to exploit the large register file 2,6. Statistical analysis shows 
thato.mpi.endonoteffective^^ . . 

aggr ^ivein-lin^^ . 
,5 conventionalsystemsmaybeat^^ 

the split register file 2 ,6. In a software system that exploits the large number ofregistersm the processor ,00 
thecompletesetofregistersissaved upon the event of a thread (context) s^tch. When only a few reg^en of 

processor ,00 by supporting individual marking of registers. Octants of the thirty-two registers can be marked as 
20 "dirty'' if used, and are consequently saved conditionally. 

,„ various embodiments, the split register file 2, 6 is leveraged by dedicating fields for globals, trap 
registers, and the like. 

Referring to FIGURE 4, a schematic block diagram shows a logical view of the register file 21 6 and 
functional unto in the processor 100. The physical implementation of the core processor 100 is simplified by 

25 re p,icatingasmglemn^^ Tne media functional un lB 220 

include circuits mat execute various arithmetic and logical operations including general-purpose code, graph.es 
code, and video-image-speech (VIS) processing. VIS processing includes video processing, image processmg, 
digital signal processing (DSP) loops, speech processing, and voice recognition algorithms, for example. 

. Referring to FIGURES 5A, SB, and SC. a schematic block diagram of a divided or split register file, a 

30 hit* level view of computation elements of a functional unit, and a pictorial view of an instruction forma, 
respectively are used to illustrate the difficulty of defining an instruction format with a limited number of 
instruction bits. FIGURE 5A shows a schematic block diagram df a decoder 502 that decodes four 
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substructions of a very long instruction word. Each of the four decoders applies control signals to one of four 
register file segments 510, 512, 514, and 516. Each of the register file segments is coupled to and associated 
with a functional unit. In the illustrative embodiment, a first register file segment 51 0 is coupled to and 
associated with a general functional unit 520. Second, third, and fourth register file segments 512, 514, and 516 
are respectively coupled to and associated with media functional units 522, 524, and 526. 

FIGURE 5B shows an example of a VLI W substruction, specifically a multiply-add (muladd) 
instruction and relates execution of the muladd instruction to computation blocks in a functional unit The 
muladd instruction specifies four register specifiers designating data that is operated upon by the functional unit 
The muladd instruction specifies three source operands R A , R* and Rc, and one destination operand R D . The 
functional unit includes a multiplier 530 that multiplies the source operands R A and R B to generate a product. 
The functional unit also includes an adder 532 that receives the product from the multiplier 530 and adds the 
product and the source operand Rc to produce a sum that is transferred to the destination register operand R D . 

For a register file in which the register file segments include N =» 2 M registers, for example, M bits are 
used to uniquely specify a particular register so that 4*M are needed to uniquely specify the four registers 
addressed in a single subinstruction. 

FIGURE 5C depicts a subinstruction storage For instructions such as the muladd instruction. Resource 
size and speed constraints are imposed on instruction storage so that the number of bits in a subinstruction are 
limited. The four register specifiers for the subinstruction use nearly the entire capacity of the subinstruction 
storage. For example, a register file segment that includes 128 bits has registers that are uniquely addressed 
using seven address bits. Addressing of four registers consumes 7*4 = 28 bits. For a subinstruction size 
constrained to 32 bits, only four bits remain for specifying an operation code or other operational information for 
controlling execution.. 

The illustrative VLIW processor partitions the register file into local and global registers to conserve 
address bits in a very long instruction word to reduce the size of the register file and accelerate access time. 

Referring to FIGURE 6, a schematic block diagram shows a register file 600 for a VLIW processor 100 
that includes global and local register partitioning. The Very Long Instruction Word (VLIW) processor has a 
plurality of functional units including three media functional units 622, 624, and 626, and a general functional 
unit 620. The processor 100 also includes a multi-ported register file 600 that is divided into a plurality of 
separate register file segments 610, 612, 614, and 616, each of the register file segments being associated to one 
of the plurality of functional units. The register file segments 610, 612, 614, and 616 are partitioned into local 
registers and global registers. The global registers are read and written by all functional units 620, 622, 624, and 
626. The local registers are read and written only by a functional unit associated with a particular register file 
segment. The local registers and global registers are addressed using register addresses in an address space that is 
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„ r -r are-isterfile segment/ functional unit pair including register file segment 610/^ 
separately defined for a register file segmcn ft , „nit 622 register file segment 614/ media 

functional unit 620, register file segment 612/ media functional unit 622 raster 

(taction*^ 

lohal listers are addressed within a selected global register range using the same register 

■ - , :«u™ntlv communicating information oy p""""" WWK * 
specifier bits in an mstn.ct.on word by mherently commun ' ^unicates 

, VLIW inaction group. The positioning of a reg.ster spec.fier » *e ^ ^ more registers 

addressinginformation. The additional information allows a comp.ler or programmer to spec.fy , 
in fewer bits than have been specified conventionally. 

Oneaddn^bitUmussavedfor^^ 

One aaa«ess ^^n. The reduction in address b.ts .s h.ghly 

subinstructionandasavmgsofl6b.tsperVLIWmstn.cn 

5 advantageous in a VL1 W processor that includes powerful funcuonal urn* that execute iarge 

actions, each of which is to be encoded in the VLIW instruction word. 

number of bits B that are used to address N i regis 
segments are addressed using the same B-bit values. 
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In some embodiments, partitioning of the register file 600 is programmable so that the number N c of 
global registers and number N L of local registers is selectable and variable. For example, a register file including 
four register file segments each having 128 registers may be programmably configured as a flat register file with 
128 global registers and 0 local registers with the 128 registers addressed using seven address bits. Alternatively, 
the four register file segments may be programmably configured, for example, to include 64 global registers and 
64 local registers so that the total number of registers is 64 + (4*64) = 320 registers that are again addressed 
using 7 bits rather than the 9 bits that would otherwise be required to address 320 registers. 

Referring to FIGURE 7, a schematic block diagram depicts an embodiment of the multiport register file 
216. A plurality of read address buses RA1 through RAN carry read addresses that are applied to decoder ports 
816-1 through 816-N, respectively. Decoder circuits are well known to those of ordinary skill in the art, and any 
of several implementations could be used as the decoder ports 816-1 through 816-N. When an address is 
presented to any of decoder ports 816-1 through 816-N, the address is decoded and a read address signal is 
transmitted by a decoder port 816 to a register in a memory cell array 818. Data from the memory cell array 818 
is output using output data drivers 822. Data is transferred to and from the memory cell array 818 under control 
of control signals carried on some of the lines of the buses of the plurality of read address buses RA1 through 
RAN. 

Referring to FIGURE 8A and 8B, a schematic block diagram and a pictorial diagram, respectively, 
illustrate the register file 216 and a memory array insert 910. The register file 216 is connected to a four 
functional units 920, 922, 924, and 926 that supply information for performing operations such as arithmetic, 
logical, graphics, data handling operations and the like. The illustrative register file 216 has twelve read ports 
930 and four write ports 932. The twelve read ports 930 are illustratively allocated with three ports connected to 
each of the four functional units. The four write ports 932 are connected to receive data from all of the four 
functional units. 

The register file 216 includes a decoder, as is shown in FIGURE 6, for each of the sixteen read and 
write ports. The register file 216 includes a memory array 940 that is partially shown in the insert 710 illustrated 
in FIGURE 8B and includes a plurality of word lines 944 and bit lines 946. The word lines 944 and bit lines 946 
are simply a set of wires that connect transistors (not shown) within the memory array 940. The word lines 944 
select registers so that a particular word line selects a register of the register file 216. The bit lines 946 are a 
second set of wires that connect the transistors in the memory array 940. Typically, the word lines 944 and bit 
lines 946 are laid out at right angles. In the illustrative embodiment, the word lines 944 and the bit lines 946 are 
constructed of metal laid out in different planes such as a metal 2 layer for the word lines ^44 and a metal 3 layer 
for the bit lines 946. in other embodiments, bit lines and word lines may be constructed of other materials, such 
as polysilicon, or can reside at different levels than are described in the illustrative embodiment, that are known 
in the art of semiconductor manufacture. In the illustrative example, the word lines 944 are separated by a 



10 



15 



20 



25 



30 



PCT/US99/28820 " 

WO 00/33178 

• 15- 

distance of about 1pm and the bit lines 946 are separated by approximately Ipm. Other circuit dimensions may 

be constructed for various processes. The il.ustrative examp.e shows one bit line per port, other embod.ments 

may use multiple bit lines per port. 

When a particular functional unit reads a particular register in the register file 216, the functional unit 

sends an address signal via the read ports 930 that activates the appropriate word Hnes to access me reg,ster. In a 
register file having a conventional structure and twelve read pons, each cell, each storing a single b,t of 
information, is connected to twelve word lines to select an address and twelve bit lines to carry data read from the 
address. 

The four write ports 932 address registers in the register file using four word lines 944 and four bit lines 
946 connected to each cell. The four word lines 944 address a cell and the four bit lines 946 carry data to the 
cell. 

Thus, if the illustrative register file 216 were laid out in a conventional manner with twelve read ports 
930 and four write ports 932 foratotal of sixteen ports and the ports were Ipm apart, one memory call would 
have an integrated circuit area of 256pm 1 (16x16). The area is proportional to the square of the number of pons. 

The register file 216 is alternatively implemented to perform single-ended reads and/or single-ended 
v^esutilizingasmglebitlmeperponpercelUrimplementedto 
writes using two bit lines per port per ceil. 

However, in this embodiment the register file 216 is not laid out in the conventional manner and instead , 
issptittatoapluralityofseparateandindividualregisterfilesegmente Referring to FIGURE 9. a 
schematic block diagram shows an arrangement of the register file 21 6 into me four register file segments 224. . 
The register file 216 remains operational as a single logical register file in the sense mat the four of the reg«ter 
file segments 224 contain the same number of registers and the same register values as a conventional reg-ster 
file of the same capacity that is not split. The separated register file segments 224 differ from a register file that 
is not split through elimination oflines that would otherwise connect ports to the memory cells. Accordmgly. 
each registerfile segment 224 has connections to onlythree of the twelve read ports 930. lines connectmg a 
register file segment to the other nine read ports are eliminated. All writes are broadcast so that each ofthe four 
re gisterfilesegme n ts224hasconnectionstoallfourwriteports932. Thus each of the four register file segments 
224 has three read ports and four write ports for a total of seven ports. The individual cells are connected to 
seven word lines and seven bit lines so that a memory array with a spacing of 1pm between lines has an area of 
approximately 49pm*. In the illustrative embodiment, the four register file segments 224 have an area 
proportional to seven squared. The.tota. area of the four register file segments 224 is therefore proportional to 49 
times 4, a total of 196. 
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The split register file thus advantageously reduces the area of the memory array by a ratio of 
approximately 256/1 96 ( 1 .3X or 30%). The reduction in area further advantageously corresponds to an 
improvement in speed performance due to a reduction in the length of the word lines 944 and the bit lines 946 
connecting the array cells that reduces the time for a signal to pass on the lines. The improvement in speed 
performance is highly advantageous due to strict time budgets that are imposed by the specification of high- 
performance processors and also to attain a large capacity register file that is operational at high speed. For 
example, the operation of reading the register file 216 typically takes place in a single clock cycle. For a 
processor that executes at 500 MHz, a cycle time of two nanoseconds is imposed for accessing the register file 
216. Conventional register Hies typically only have up to about 32 registers in comparison to the 128 registers in 
the illustrative register file 216 of the processor 100. A register file 216 that is substantially larger than the 
register file in conventional processors is highly advantageous in high-performance operations such as video and 
graphic processing. The reduced size of the register file 216 is highly useful for complying with time budgets in 
a large capacity register file. 

In some embodiments, the area of a register file is further reduced by using a special memory cell for 
the local registers that have write port connections to the functional unit that is locally associated with the register 
file segment. Thus the local registers are only written by the local functional unit. In the illustrative register file 
216, the special cell for local registers has only a single write port, reducing the number of word lines to four. 
The number of bit lines connected to the local registers is also reduced to four, allowing further compactness to 
the cell. 

Referring to FIGURE 10, a simplified schematic timing diagram illustrates timing of the processor 
pipeline 1100. The pipeline 1100 includes nine stages including three initiating stages, a plurality of execution 
phases, and two terminating stages. The three initiating stages are optimized to include only those operations 
necessary for decoding instructions so that jump and call instructions, which are pervasive in the Java™ 
language, execute quickly. Optimization of the initiating stages advantageously facilitates branch prediction 
since branches, jumps, and calls execute quickly and do not introduce many bubbles. 

The first of the initiating stages is a fetch stage 1110 during which the processor 100 fetches instructions 
from the 16Kbyte two-way set-associative instruction cache 210. The fetched instructions are aligned in the 
instruction aligner 212 and forwarded to the instruction buffer 214 in an align stage 11 12, a second stage of the 
initiating stages. The aligning operation properly positions the instructions for storage in a particular segment of 
the four register file segments 310, 312, 314, and 316 and for execution in an associated functional unit of the 
three media functional units 220 and one general functional unit 222. In a third stage, a decoding stage 1114 of 
the initiating stages, the fetched and aligned VLI W instruction packet is decoded and the scoreboard (not shown) 
is read and updated in parallel. The four register file segments 310, 312, 314, and 316 each holds either floating- 
point data or integer data. The register files are read in the decoding (D) stage. 
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Following the decoding stage 1114. the execution stages are performed. The two terminating stages 
include a trap-hand.ing stage 1 160 and a write-back stage 1 162 during which result data is written-back to the 
split register file 216. 

While the invention has been described with reference to various embodiments, it will be understood 
5 that these embodiments are illustrative and that the scope of the invention is not limited to them. Many 

variations, modifications, additions and improvements of the embodiments described are possible. For example, 
those skilled in the art will readily implement the steps necessary to provide the structures and methods disclosed 
herein, and will understand that the process parameters, materials, and dimensions are given by way of example only 
and can be varied to achieve the desired structure as well as modifications which are within the scope of the 
10 invention. Variations and modifications of the embodiments disclosed herein may be made based on the descriptor, 
se tformherein,wimomdepartmgfrom^^ 

example, the described structure and operating method may be applied to a register file and processor of any suttable 
size. The register file may be much larger or much smaller than the described 128 registers. The very long 
instruction word may include any suitable number of subinstructions. 

15 Similarly, although the illustrative register file has one bit line per port, in other embodiments more bit 

lines may be allocated for a port The described word lines and bit lines are formed of a metal. In other 
examples, other conductive materials such as doped polysilicon may be employed for interconnects. The 
described register file uses single-ended reads and writes so that a single bit line is employed per bit and per port. 
In other processors, differential reads and writes with dual-ended sense amplifiers may be used so that two b.t 

20 lines are allocated per bit and per port, resulting in a bigger pitch. Dual-ended sense amplifiers improve memory 
fidelity but greatly increase the size of a memory array, imposing a heavy burden on speed performance. Thus 
the advantages attained by the described register file structure are magnified for a memory using differential 
reads and writes. The spacing between bit lines and word lines is described to be approximately lpm. In some 
processors, the spacingmay be greaterthan lum. In other processors the spacing between lines is less than lum. 



WO 00/33 1 78 PCT/US99/28820 * 



18- 



WE CLAIM 

1 1 . A processor comprising: 

2 a plurality of functional units; and 

3 a register file characterized in that the register file is divided into a plurality of register file segments, 

4 ones of the plurality of register file segments being coupled to and associated with ones of the 

5 plurality of functional units, the register file segments being partitioned into global registers 

6 and local registers, the global registers that are accessible by the plurality of functional units, 

7 the local registers being accessible by the functional unit associated with the register file 
8. segment containing the local registers. 



1 2. A processor comprising: 

2 a decoder for decoding a very long instruction word including a plurality of sub instructions, the 

3 substructions being allocated into positions of the instruction word; 

4 a register file coupled to the decoder and divided into a plurality of register file segments; and 

5 a plurality of functional units, ones of the plurality of functional units being coupled to an associated 

6 with respective ones of the register file segments, ones of the plurality of subinstructions being 

7 executable upon respective ones of the plurality of functional units, operating upon operands 

8 accessible to the register file segment associated with the functional unit of the plurality of 

9 functional units, the register file segments including a plurality of registers that are partitioned 

10 into global registers and local registers, the global registers being accessible by the plurality of 

1 1 functional units, the local registers in one of the register file segments being accessible by the 

12 functional unit associated with the register file segment 

1 3. A processor according to either Claim 1 or Claim 2 wherein: 

2 the processor is a Very Long Instruction Word (VLIW) processor. 

1 4. A processor according to Claim 1 or Claim 2 wherein: 

2 the local registers and global registers are addressed using register addresses in an address space that is 

3 defined for a register file segment/ functional unit pair. 



1 

2 



5. A processor according to Claim 1 or Claim 2 wherein: 
the register file is a multi-ported register file. 
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6. A processor according to Claim 1 or Claim 2 wherein: 

the local registers in a register file segment are addressed using register addresses in a local register 
range outside the global register range that are assigned within a single register file segment/ 
functional unit pair. 

7. A processor according to Claim 1 or Claim 2 wherein: 

register addresses in the local register range are the same for the plurality of register file segment/ 

functional unit pairs and address registers locally within a register file segment/ functional unit 
pair. 

8. A processor according to Claim 1 or Claim 2 wherein: 

the register file includes N physical registers and is duplicated into M register file segments, the register 
file segments having a reduced number of read and/or write ports in comparison to a 
nonduplicated register file, but each having the same number of physical registers. 

9. A processor according to Claim 8 wherein: 

the register file segments are partitioned into N 0 global and N L local register files where N 0 plus N L is 
' equal to N, the register file operating equivalemly to a register file having N 0 + (M • N t ) total 
registers available for the M functional units, the number of address bits for addressing the N 0 
+ (M • NO total registers being equal to the number of bits B that are used to address N = 2 B 
registers, the local registers for ones of the M register file segments are addressed using the 
same B-bit values. 

10. A processor according to Claim 9 wherein: 

partitioning of the register file is programmable so that the number N 0 of global registers and number 
N L of local registers is selectable and variable. 

U. A processor according to Claim 1 or Claim 2 wherein the register file is a storage array structure 
having R read ports and W write ports comprising: 
a plurality of storage array storages; 

the storage array storages having a reduced number of read ports so that the total number of read ports 

for the plurality of storage array storages is R read ports; and 
the storage array storages having W write ports. 
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1 12. A processor according to Claim 1 1 wherein: 

2 the storage array structure is a sixteen port structure with twelve read ports and five write ports; and 

3 the plurality of storage array storages includes four storage array storages each having three read ports 

4 and five write ports. 

1 ... 13. A processor according to Claim 11 wherein: 

2 the storage array structure is a sixteen port structure with twelve read ports and four write ports; and 

3 the plurality of storage array storages includes four storage array storages each having three read ports 

4 and four write ports. 

1 14. A processor according to Claim 1 1 wherein: 

2 the writes are fully broadcast so that all of the storage array storages are held coherent. 

1 15. A processor according to Claim 1 1 wherein: 

2 storage array storages include storage cells having a plurality of word lines and a plurality of bit lines, 

3 the word lines being formed in one metal interconnect layer, the bits lines being formed in a 

4 second metal interconnect layer. 

1 16. A method of operating a processor comprising: 

2 operating a plurality of functional units; and 

3 dividing a register file into a plurality of register file segments; 

4 coupling and associating ones of the plurality of register file segments with ones of the plurality of 

5 functional units; « 

6 partitioning the register file segments into global registers and local registers; 

7 accessing the global registers by the plurality of functional units; 

8 accessing the local registers by the functional unit associated with the register file segment containing 

9 the local registers. 

1 17. A method according to Claim 16 further comprising: 

2 addressing the local registers and global registers using register addresses in an address space that is 

3 defined for a register file segment/ functional unit pair. 
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18. A method according to Claim 1 6 further comprising: 

addressing the local registers in a register file segment using register addresses in a local register range 
outside the global register range that are assigned within a single register file segment/ 
functional unit pair. 

19. A method according to Claim 16 further comprising: 

addressing the local register range the same for the plurality of register file segment/ functional unit 
pairs and address registers locally within a register file segment/ functional unit pair. 

20. A method according to Claim 16 further comprising: 
including N physical registers in the register file; 

duplicating the physical registers into M register file segments, the register file segments having a 

reduced number of read and/or write ports in comparison to a nonduplicated register file, but 
each having the same number of physical registers. 

21 . A method according to Claim 20 further comprising: 

partitioning the register file segments into N G global and N u local register files where N G plus N L is 
equal to N ; 

operating the register file equivalent* to a register file having N c + (M * >U total registers available for 
the M functional units, the number of address bits for addressing the N 0 + (M • total 
registers being equal to the number of bits B that are used to address N - 2 B registers; and 

addressing the local registers for ones of the M register file segments using the same B-bit values. 

22. A method according to Claim 20 further comprising: 

programmably partitioning the register file so that the number N 0 of global registers and number N u of 
local registers is selectable and variable. 
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